Modifying the congestion control algorithm applied to a connection based on request characteristics

ABSTRACT

An edge server receives a first request message for transmission to the host device. The edge server determines a first congestion control algorithm based on the first request message, including characteristics of the first request message. The edge server applies the first congestion control algorithm to the transport connection for application to the transmission of the first request message. Subsequently, the edge server receives a second request message for transmission to the host device over the transport connection. Based on the second request message, including characteristics of the second request message, the edge server determines and applies a second congestion control algorithm to the transport connection for application to the transmission of the second request message, wherein the second congestion control algorithm is different from the first congestion control algorithm

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.16/798,892, filed Feb. 24, 2020, which is hereby incorporated byreference.

FIELD

Embodiments of the invention relate to the field of networkcommunications, and more specifically, to modifying the congestioncontrol algorithm applied to a connection based on requestcharacteristics.

BACKGROUND

Internet hosts are concerned with maintaining high security,performance, and reliability of their hosted resources, such aswebsites. As the popularity of a resource increases, so does the amountof network traffic that is directed to the resource. Excessive orunmanaged network traffic can result in network congestion, andultimately, dropped network traffic, affecting the security, performanceand reliability of a resource. One tool for mitigating the negativeeffects of excessive or unmanaged network traffic is to apply congestioncontrol algorithms. Congestion control algorithms can use varioustechniques to regulate network traffic to prevent network congestion,including a slow start strategy and modifications to TCP congestionwindows. A slow start strategy starts by sending a small amount of dataand slowly increases the amount of data transmitted until it reaches acertain point (e.g., a slow start threshold, the network's maximumcarrying capacity, or another value). The congestion window indicatesthe maximum amount of data that can be sent out on a connection withoutbeing acknowledged. An example congestion control algorithm can decreasethe congestion window when an acknowledgement for a packet is notreceived within an estimated or expected timeout period.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention may best be understood by referring to the followingdescription and accompanying drawings that are used to illustrateembodiments of the invention. In the drawings:

FIG. 1 illustrates an exemplary networked system according to someembodiments described herein;

FIG. 2 illustrates an exemplary networked system according to someembodiments described herein;

FIG. 3 is a flow diagram that illustrates exemplary operations fordynamically selecting a congestion control algorithm based on one ormore request characteristics according to an embodiment;

FIG. 4 is a flow diagram that illustrates exemplary operations forapplying congestion control algorithms per request on a transportconnection according to an embodiment; and

FIG. 5 illustrates a block diagram for an exemplary data processingsystem 500 that may be used in some embodiments.

DESCRIPTION OF EMBODIMENTS

Transfer rates of network traffic between devices are limited by thephysical channels upon which the network traffic travel, such asethernet cables and cellular links, and often by the number of devicesconnected. Network congestion can occur when network traffic is so heavy(e.g., greater than the physical channels can handle) that it clogs upthe physical channels and slows down response times, resulting in delaysand/or dropped packets. To reduce or limit the amount of congestion ofnetwork traffic on a connection, congestion control algorithms can beapplied with the objective of allowing an amount of network trafficbelow a congestion level.

In conventional solutions, when a client (e.g., a browser or othernetwork application such as a mobile application using an HTTP library)creates a new HTTP/S connection, a congestion control algorithm isdetermined prior to the client sending a request. In the case of TCP, aTCP server initializes a congestion control algorithm when the new TCPconnection is accepted (e.g., when accept( ) is returned).Conventionally, the chosen connection control algorithm is fixed for thelifetime of the connection, which may involve multiple requests andresponses (e.g., multiple http/s requests). To manage congestion on aconnection, TCP can use a congestion window (“cwnd”), which is a valueindicating the amount of data (e.g., number of bytes) that can be sentinto the network before receiving an acknowledgement. Typically, when anew connection is established, the congestion window is initialized at asmall value and increased over time. Congestion is detected either bythe receipt of a duplicate acknowledgement or a timeout signal. Whenthis occurs, the send rate can be decreased by decreasing the congestionwindow size based on the configuration of the chosen congestion controlalgorithm.

However, a fixed congestion control algorithm for all network traffic onthe transport connection can result in inefficiencies in how networktraffic is sent over the transport connection. For example, a fixedcongestion control algorithm may be ideal for one type of networktraffic, but not for other types of network traffic, and a transportconnection may be tasked with carrying multiple types of networktraffic.

The embodiments described herein provide mechanisms for modifying thecongestion control algorithm applied to a connection based on one ormore request characteristics. In one embodiment, an edge server thathandles network traffic between a client device and host devicedetermines a congestion control algorithm by evaluating requestcharacteristics of a request message. In some embodiments, requestcharacteristics can include the contents of the request itself,including pattern matching a requested pathname, determining contentlength of the requested content, and an evaluation of other header data,etc., or a characteristics of the source of the request, includingwhether the request was received via a mobile connection or a Wi-Ficonnection. Based on the request characteristics, the edge server canapply a congestion control algorithm. Upon receiving a subsequentrequest message, the edge server can evaluate the requestcharacteristics of the subsequent request message, and determine that adifferent congestion control algorithm should be applied to thetransport connection.

Embodiments of the invention provide many technical advantages, inaddition to addressing the deficiencies of previous solutions. Forexample, when a transport connection is established that will be taskedwith handling multiple types of resources of varying sizes (e.g., ashort API request or a large file download), the ability to applydifferent congestion control algorithm per request type or response typeprovides greater efficiencies in how network traffic is managed.

FIG. 1 illustrates an exemplary networked system according to someembodiments described herein. The exemplary networked system illustratedin FIG. 1 includes edge server(s) 120 that are situated between clientdevices 110A-I and origin server(s) 130A-N.

In one embodiment, edge server(s) 120 terminates transport connectionsbetween an edge server 120 and client devices 110A-I (e.g., transportconnection 140), in addition to establishing transport connectionsbetween edge server 120 and origin servers 130A-N (e.g., transportconnection 150). The transport connection 140 may be a TCP connection, aQUIC, or other transport layer protocol connection. In some embodiments,origin servers 130A-N host resources or other content that can berequested by client devices 110A-I. In one embodiment, the edgeserver(s) 120 is configured to receive requests to access and/or modifythe resources hosted by the origin servers 130A-N, and further receivesresponses to such requests with the requested resources from the originservers 130A-N. For example, web traffic (e.g., HTTP requests/responses,HTTPS requests/responses, HTTP/2 requests/responses, HTTP/3requests/responses, etc.) for domains handled by origin servers 130A-Nmay be received via transport connection 140 and processed at edgeserver(s) 120. In one embodiment, as part of handling requests to accessresources, the edge server(s) 120 is further configured to retrieveand/or analyze properties of each request and each response and, basedat least on those properties, perform actions on transport connection140 between client devices 110A-I and edge servers 120.

Examples of client devices 110A-I include computing devices (e.g.,laptops, workstations, smartphones, palm tops, mobile phones, tablets,gaming systems, set top boxes, wearable devices, electronic devices,etc.) that are capable of transmitting and/or receiving network traffic.In one embodiment, each of client devices 110A-I executes client networkapplication 115 that is capable of transmitting and/or receiving networktraffic. For example, client network application 115 may be a webbrowser or other application that can access network resources (e.g.,web pages, images, word processing documents, PDF files, movie files,music files, or other computer files).

Examples of origin servers 130A-N include computing devices that mayserve and/or generate network resources (e.g., web pages, images, wordprocessing documents, PDF files movie files, music files, or othercomputer files). Origin servers 130A-N may also be another edge serverto the server that serves and/or generates network resources. Althoughnot illustrated in FIG. 1 , it should be understood that the networkresources of origin servers 130A-N may be stored separately from thedevice that responds to the requests. One or more of origin servers130A-N may handle multiple domains that resolve to edge server(s) 120.

The service may also include control server 125, which may be owned oroperated by the service. In some embodiments, control server 125 mayreceive a command from edge server(s) 120 to determine and apply theappropriate congestion control rules described herein.

In one embodiment, edge server(s) 120, or optionally control server 125,includes congestion control module 170 and congestion control rulesstorage 175. Congestion control module 170 is configured to analyzerequest messages from client devices 110A-I and response messages fromorigin servers 130A-N. Congestion control module 170 is furtherconfigured to access congestion control rules stored in congestioncontrol rules storage 175 and apply one of a plurality of congestioncontrol algorithms to connections between client devices 110A-I and edgeservers 120. For example, an edge server 120 can accept transportconnection 140 from a client device (e.g., client device 110A) to edgeserver 120.

In one embodiment, congestion control rules storage 175 stores aplurality of congestion control rules that can be used by congestioncontrol module 170 to determine the appropriate congestion controlalgorithm to apply to transport connection 140. In some embodiments,congestion control rules storage 175 includes profiles or datastructures, where the profiles or data structures store informationindicating congestion control rules associated with a particular originserver, a particular resource type, a resource size range, etc.

In some embodiments, congestion control rules in congestion controlrules storage 175 are based on pattern matching to content in a requestmessage or response message. For example, congestion control module 170can select a congestion control algorithm based on the content of apathname (e.g., URL) or a header of a request/response message. For apathname, the congestion control rules can be based on pattern matchinga word, a number, or a regex in a request message. For example, apathname with the word “download” may result in a congestion controlalgorithm being applied that is better suited for large files, while apathname with the word “image” or “txt” may result in a congestioncontrol algorithm being applied that is better suited for smaller files.For a header, the congestion control rules can be based on identifying avalue of a content-length header in a header portion of a responsemessage, where a first congestion control algorithm is applied when thevalue is below a threshold and a second congestion control algorithm isapplied when the value is above the threshold, or vice versa.

FIG. 2 illustrates an exemplary networked system according to someembodiments described herein. The exemplary networked system illustratedin FIG. 2 includes client devices 210A-I communicating with server(s)220 via transport connection 240, where server(s) 220 host resources orother content that can be requested by client devices 210A-I (e.g., byclient network application 215 operating on client devices 210A-I).

Examples of client devices 210A-I include computing devices (e.g.,laptops, workstations, smartphones, palm tops, mobile phones, tablets,gaming systems, set top boxes, wearable devices, electronic devices,etc.) that are capable of transmitting and/or receiving network traffic.In one embodiment, each of client devices 210A-I executes client networkapplication 215 that is capable of transmitting and/or receiving networktraffic. For example, client network application 215 may be a webbrowser or other application that can access network resources.

In one embodiment, server(s) 220, similar to origin servers 130A-N inFIG. 1 , can include computing devices that may serve and/or generatenetwork resources (e.g., web pages, images, word processing documents,PDF files movie files, music files, or other computer files). Server(s)220 further includes congestion control module 270 and congestioncontrol rules storage 275, which are similar to congestion controlmodule 170 and congestion control rules storage 175, respectively, asdescribed above with respect to FIG. 1 .

In some embodiments, because congestion control module 270 is located onthe same server (e.g., server(s) 220) as the resources that arerequested in a request message from client devices 210A-I, congestioncontrol module 270 can have more insight into the details of therequested resource. For example, congestion control module 270 canidentify the size of the requested resource without parsing through aheader portion of a response message to locate a value of acontent-length header.

FIG. 3 is a flow diagram 300 that illustrates exemplary operations fordynamically selecting a congestion control algorithm based on one ormore request characteristics according to an embodiment. The operationsof FIG. 3 will be described with reference to the exemplary embodimentof FIG. 1 . However, it should be understood that the operations of FIG.3 can be performed by embodiments of the invention other than thosediscussed with reference to FIG. 1 , and the embodiments discussed withreference to FIG. 1 can perform operations different than thosediscussed with reference to FIG. 3 . For instance, the embodimentsdescribed in FIG. 3 can be performed by embodiments with reference toFIG. 2 . The operations of FIG. 3 are described as being performed byone or more edge servers (e.g., edge server(s) 120). In someembodiments, the operations are performed by congestion control module170 operating on edge server(s) 120.

In operation 305, an edge server (e.g., edge server 120) receives arequest message from a client device (e.g., client device 110A) directedto an origin server (e.g., origin server 130A). Prior to receiving therequest message, a connection (e.g., transport connection 140) isestablished between client device 110A and edge server 120. For example,an edge server 120 can accept transport connection 140 initiated by aclient device (e.g., client device 110A) to edge server 120. In someembodiments, edge server 120 selects a default or initial controlcongestion algorithm when the transport connection is established. Edgeserver 120 utilizes transport connection 140 to handle request messagesfrom client device 110A and response messages directed to client device110A (e.g., HTTP/S request/responses). In the embodiment of FIG. 2 , theserver 220 receives a request message from a client device 210A-I over atransport connection 240.

In operation 310, edge server 120 determines whether one or morecharacteristics of the request message match one or more congestioncontrol rules. In some embodiments, request message characteristics caninclude the contents of the request itself, including pattern matching arequested pathname, determining content length of the requested content,and an evaluation of other header data, etc., or a characteristics ofthe source of the request, including whether the request was receivedvia a mobile connection or a Wi-Fi connection.

In one embodiment, edge server 120 determines whether one or morecharacteristics of the request message match one or more congestioncontrol rules by performing a pattern matching process to match aspecific word or phrase in the request (e.g., within a pathname in anHTTP request header) with the elements of one or more congestion controlrules.

In some cases, when a resource requested in the request message and/orthe content-length header of the corresponding response is cached atedge server 120, edge server 120 can determine the size of the responsemessage. In another embodiment, edge server 120 identifies a value ofthe content-length header of the response to the request that indicatesa size of the body of the response. In some embodiments, edge server 120uses other information in the response header to determine whichcongestion control algorithm to use. For example, the information storedin a “content-type” field can be used to select a congestion controlalgorithm. In some embodiments, edge server 120 determinescharacteristics of the source of the request message to determine acongestion control algorithm. For example, edge server 120 can selectdifferent congestion control algorithms based on whether the requestmessage was received via a mobile connection or a Wi-Fi connection,e.g., by identifying the information stored in the source IP fields, auser-agent value, or another field in a request header that identifiesclient network information.

When the request message matches one or more of the congestion controlrules, the flow proceeds to operation 315. In operation 315, when atleast one characteristic of the request message matches one or morecongestion control rules, edge server 120 determines a particularcongestion control algorithm based, at least in part, on thecharacteristics of the request message. For example, a congestioncontrol rule can apply a first congestion control algorithm when thepathname includes the word “download,” and a second congestion controlalgorithm otherwise. In some cases, a congestion control rule can applya specific congestion control algorithm for all network trafficassociated with a particular domain. In some cases, edge server 120identifies a value of the content-length header of the response messagethat indicates a size of the body of the response message. In somecases, where the resource requested in the request message and/or thesize of the resource is known (e.g., cached) at edge server 120, edgeserver 120 can determine the size of the response message prior togenerating the response message. After the appropriate congestioncontrol algorithm has been determined, the flow proceeds to operation335.

When the request message does not match one or more of the congestioncontrol rules, the flow proceeds to operation 320. At this point, edgeserver 120 processes the request in the request message (e.g., byforwarding the request to origin server 130A or retrieving resourcescached at edge server 120 on behalf of origin server 130A). Further, insome embodiments, where the request message does not match one or moreof the congestion control rules, edge server 120 can apply a defaultcongestion control algorithm or no congestion control algorithm.

In operation 320, edge server 120 receives a response message, e.g.,from the one or more of origin servers 130A-N directed to the requestingclient device from operation 305. In one embodiment, edge server 120receives the response message via transport connection 150 establishedbetween origin servers 130A-N and edge server 120. In some embodiments,the response message is generated by edge server 120 on behalf of originserver 130A, for example, if the requested resource is stored in a cacheor memory of edge server 120.

In operation 325, edge server 120 determines whether characteristics ofthe response message match one or more congestion control rules,triggering the application of one of a plurality of congestion controlalgorithms. For example, edge server 120 can perform a pattern matchingas described above with respect to operation 310. For example, when edgeserver 120 receives the response message from the one or more of originservers 130A-N directed to the requesting client device, edge server 120can analyze the response message to determine the size of the responsemessage (e.g., from the content-length header of the response message).

When the response message matches one or more of the congestion controlrules, the flow proceeds to operation 315, and performs the actionsdescribed above. For example, edge 120 can identify a value of thecontent-length header of the response message that indicates a size ofthe body of the response message. In some embodiments, edge server 120can determine a first congestion control algorithm to apply when thevalue of the content-length header of the response message is below athreshold and a second congestion control algorithm to apply when thevalue of the content-length header of the response message is above thethreshold.

When the response message does not match one or more of the congestioncontrol rules, the flow proceeds to operation 330. In operation 330,edge server 120 can apply a default congestion control algorithm or,alternatively, no congestion control algorithm to transport connection140.

After applying the default congestion control algorithm, edge server 120initiates sending the response message to client device 110A viatransport connection 140 and the flow proceeds back to operation 305where edge server 120 receives a subsequent request message.

In operation 335, edge server 120 applies the determined congestioncontrol algorithm to transport connection 140. If the determinedcongestion control algorithm is the same congestion control algorithmthat is applied to the transport connection 140, then the congestioncontrol algorithm is not changed. In some embodiments, applying thedetermined congestion control algorithm further includes firstdetermining whether transport connection 140 is idle. In someembodiments, a connection is idle when the sender has no in-flight datarequiring an ACK from the receiver. In some cases, edge server 120applies the determined congestion control algorithm only if transportconnection 140 is idle. For example, if HTTP/2 or HTTP/3 is being used,the determined congestion control algorithm may be applied responsive todetermining that transport connection 140 is idle. If HTTP 1.1 is used,the determined congestion control algorithm may be applied prior tosending the response message when the connection is idle. However, insome embodiments, even when the connection is not idle, there are statesthat permit changing the congestion control algorithm on a transportconnection. For example, if transport connection 140 is currently usinga Cubic congestion control algorithm, the congestion control algorithmcan be changed to a Reno congestion control algorithm, even when notidle.

After applying the determined congestion control algorithm, edge server120 initiates sending the response message to client device 110A viatransport connection 140 and the flow proceeds back to operation 305where edge server 120 receives a subsequent request message.

FIG. 4 is a flow diagram 400 that illustrates exemplary operations forapplying congestion control algorithms per request on a transportconnection according to an embodiment. The operations of FIG. 4 will bedescribed with reference to the exemplary embodiment of FIG. 1 .However, it should be understood that the operations of FIG. 4 can beperformed by embodiments of the invention other than those discussedwith reference to FIG. 1 , and the embodiments discussed with referenceto FIG. 1 can perform operations different than those discussed withreference to FIG. 4 . The operations of FIG. 4 are described as beingperformed by one or more edge servers (e.g., edge server(s) 120). Insome embodiments, the operations are performed by congestion controlmodule 170 operating on edge server(s) 120.

In operation 405, the edge server (e.g., edge server(s) 120)participates in establishing a transport connection (e.g., transportconnection 140) for handling network traffic between a client device(e.g., client device 110A) and edge server 120. Transport connection 140can be established by client device 110A. Edge server 120 can alsoparticipate in establishing a transport connection (e.g., transportconnection 150) for handling network traffic between a host device(e.g., origin server 130A) and edge server 120. In one embodiment, edgeserver 120 receives HTTP (or similar) requests and sends HTTP (orsimilar) responses via transport connection 140. In one embodiment,transport connection 140 is established with the client device toreceive request messages from client device 110A on behalf of, anddirected to, origin server 130A. In some embodiments, the requestmessages request to access or modify resources hosted by origin server130A. In some embodiments, edge server 120 can either send the requestmessage to origin server 130A, for example, via transport connection150, or edge server 120 can retrieve the requested resources stored in amemory at edge server 120. In embodiments where edge server 120 sendsthe request message to origin server 130A, edge server 120 subsequentlyreceives a response message from origin server 130A via transportconnection 150, where the response messages include the requestedresources from origin server 130A, and send the requested resources tothe requesting client device 110A via transport connection 140.

In operation 408, in some embodiments, when transport connection 140 isfirst established, edge server 120 applies a default congestion controlalgorithm that is to be applied on subsequent network traffic sent ontransport connection 140.

In operation 410, edge server 120 receives a first request message, overthe transport connection. The first request message may be an HTTP/Srequest. For example, edge server 120 receives an HTTP “GET” request toaccess a resource hosted by origin server 130A via transport connection140. In one embodiment, the requested resource is an HTML page locatedat, e.g., www.example.com/index.html. The request message may include arequest for an action to be performed on the resource. In oneembodiment, edge server 120 receives the request message because of aDNS for the hostname resolving to an IP address assigned to edge server120 instead of resolving to an IP address of the origin server hostingthe resource.

In operation 415, edge server 120 determines a first congestion controlalgorithm based on the first request message. Edge server 120 determineswhich one of multiple congestion control algorithms to use as the firstcongestion control algorithm based on one or more characteristics of thefirst request message and/or one or more characteristics derived fromthe processing of the first request message. The characteristic(s) ofthe first request message may be included within the first requestmessage (e.g., request URI) and/or derived from the first requestmessage (e.g., network type). The characteristic(s) of the processing ofthe first request message may include analyzing the response header(e.g., the content-length header of a response message sent in responseto the first request message). In some embodiments, edge server 120determines whether the characteristics of the first request messagematches one or more congestion control rules stored by edge server 120.

In one embodiment, edge server 120 parses a pathname of the firstrequest message. In such embodiments, edge server 120 can recognizewords, number, and/or regular expressions (regex) in the pathname thatmay be indicative of the size of the requested resources/content. Forexample, a pathname that includes “download.foo.com” may be indicativeof a larger resource than a pathname that includes “images.foo.com.” Insome embodiments, edge server 120 accesses a mapping table that mapswords, numbers, and/or regular expressions to specific congestioncontrol algorithms. Based on this determination, edge server 120 canselect the appropriate congestion control algorithm to apply totransport connection 140. Examples of congestion control algorithmsinclude, but are not limited to, New Reno, Vegas, BIC, CUBIC, BBR, andCompound TCP.

In another embodiment, where a resource requested in the first requestmessage or a content-length header of the resource is cached by edgeserver 120, edge server 120 determines the size of a response messagethat will be sent in response to the first request message. The value ofthe content-length header of the first request message indicates thelength of the request body of the first request message (in number ofbytes). In some embodiments, edge server 120 selects the congestioncontrol algorithm based on the value of the content-length header ascompared to a threshold value. In other embodiments, edge server 120selects the congestion control algorithm from a table, or other datastructure, that includes a plurality of congestion control algorithms.

In some embodiments, the determined first congestion control algorithmcan be different or the same as the default congestion controlalgorithm. For example, based on the evaluation of the first requestmessage, edge server 120 can determine that the appropriate congestioncontrol algorithm is the default congestion control algorithm. In such ascenario, edge server 120 does not change the congestion controlalgorithm on the transport connection.

In operation 420, edge server 120 applies the first congestion controlalgorithm to the transport connection for application to thetransmission of a first response message to the first request message.In one embodiment, edge server 120 applies the first congestion controlalgorithm in place of a default congestion control algorithm.

In one embodiment, edge server 120 applies the first congestion controlalgorithm based on a connection type of transport connection 140. Forexample, if HTTP 1.1 is used over transport connection 140, in whichmessages are serialized, edge server 120 applies the first congestioncontrol algorithm to the next request/response message. If HTTP/2 orHTTP/3 is used over transport connection 140, in which messages aremultiplexed, allowing multiple messages to be processed in parallel overa single TCP or QUIC connection, edge server 120 first determineswhether transport connection 140 is idle. Transport connection 140 isconsidered idle when there is no data currently in-flight. Whentransport connection 140 is idle, edge server 120 applies the firstcongestion control algorithm. When transport connection 140 is not idle,edge server 120 does not apply the first congestion control algorithm orwaits until the connection becomes idle and then applies the firstcongestion control algorithm.

In operation 425, edge server 120 receives a second request message fortransmission to the host device via the transport connection. In oneembodiment, subsequent to receiving the first request message, edgeserver 120 receives the second request message requesting resourceshosted by origin server 130A via transport connection 140.

In operation 430, edge server 120 determines a second congestion controlalgorithm based on the second request message. In some embodiments, edgeserver 120 determines the second congestion control algorithm in thesame manner as edge server 120 determined the first congestion controlalgorithm, as in operation 415 described above. For example, edge server120 can determine whether the characteristics of the second requestmessage matches one or more congestion control rules.

In operation 435, edge server 120 applies the second congestion controlalgorithm to the transport connection for application to thetransmission of a second response message to the second request message,where the second congestion control algorithm is different from thefirst congestion control algorithm. In one embodiment, as describedabove with respect to operation 420, edge server 120 applies the secondcongestion control algorithm based on a connection type of transportconnection 140. When HTTP 1.1 is used over transport connection 140,edge server 120 applies the second congestion control algorithm inbetween requests. When HTTP/2 or HTTP/3 is used over transportconnection 140, edge server 120 does not change the congestion controlalgorithm unless transport connection 140 is idle. When transportconnection 140 is not idle, edge server 120 sends the second requestmessage using the first congestion control algorithm. In someembodiments, edge server 120 waits until the connection becomes idle andthen applies the second congestion control algorithm to transportconnection 140.

In some embodiments, when edge server 120 applies a new congestioncontrol algorithm, the new algorithm is started at a new slow startrate. However, in other embodiments, edge server 120 can determine anexpected bandwidth for the transport connection based on a history ofthe transport connection (e.g., from previous connections/request). Insuch embodiments, edge server 120 can start/initiate the new congestioncontrol algorithm at another state based on the expected bandwidth andround-trip time for the transport connection. For example, edge server120 can initiate the new congestion control algorithm with differentvalues for congestion control state variables. Examples of congestioncontrol state variables include a congestion window (“cwnd”) and a slowstart threshold (“ssthresh”).

FIG. 5 illustrates a block diagram for an exemplary data processingsystem 500 that may be used in some embodiments. One or more such dataprocessing systems 500 may be utilized to implement the embodiments andoperations described with respect to the edge server, origin server,and/or client device.

The data processing system 500 is an electronic device that stores andtransmits (internally and/or with other electronic devices over anetwork) code (which is composed of software instructions and which issometimes referred to as computer program code or a computer program)and/or data using machine-readable media (also called computer-readablemedia), such as machine-readable storage media 510 (e.g., magneticdisks, optical disks, read only memory (ROM), flash memory devices,phase change memory) and machine-readable transmission media (alsocalled a carrier) (e.g., electrical, optical, radio, acoustical or otherform of propagated signals—such as carrier waves, infrared signals),which is coupled to the processing system 520. The processing system 520may be one or more processors and/or connected system components such asmultiple connected chips. The depicted machine-readable storage media510 may store program code 530 that, when executed by the processor(s)520, causes the data processing system 500 to perform the operationsdescribed herein.

The data processing system 500 also includes one or more networkinterfaces 540 (e.g., a wired and/or wireless interfaces) that allowsthe data processing system 500 to transmit data and receive data fromother computing devices, typically across one or more networks (e.g.,Local Area Networks (LANs), the Internet, etc.). The data processingsystem 500 may also include one or more input or output (“I/O”)components 550 such as a mouse, keypad, keyboard, a touch panel or amulti-touch input panel, camera, frame grabber, optical scanner, anaudio input/output subsystem (which may include a microphone and/or aspeaker), other known I/O devices or a combination of such I/O devices.Additional components, not shown, may also be part of the system 500,and, in certain embodiments, fewer components than that shown may bepart of the system 500.

The techniques shown in the figures can be implemented using code anddata stored and executed on one or more computing devices (e.g., clientdevices, servers, etc.). Such computing devices store and communicate(internally and/or with other computing devices over a network) code anddata using machine-readable media, such as machine-readable storagemedia (e.g., magnetic disks; optical disks; random access memory; readonly memory; flash memory devices; phase-change memory) andmachine-readable communication media (e.g., electrical, optical,acoustical or other form of propagated signals—such as carrier waves,infrared signals, digital signals, etc.). In addition, such computingdevices typically include a set of one or more processors coupled to oneor more other components, such as one or more storage devices, userinput/output devices (e.g., a keyboard, a touchscreen, and/or adisplay), and network connections. The coupling of the set of processorsand other components is typically through one or more busses and bridges(also termed as bus controllers). The storage device and signalscarrying the network traffic respectively represent one or moremachine-readable storage media and machine-readable communication media.Thus, the storage device of a given computing device typically storescode and/or data for execution on the set of one or more processors ofthat computing device. Of course, one or more parts of an embodiment ofthe invention may be implemented using different combinations ofsoftware, firmware, and/or hardware.

In the preceding description, numerous specific details are set forth.However, it is understood that embodiments of the invention may bepracticed without these specific details. In other instances, well-knowncircuits, structures and techniques have not been shown in detail inorder not to obscure the understanding of this description. Those ofordinary skill in the art, with the included descriptions, will be ableto implement appropriate functionality without undue experimentation.

References in the specification to “one embodiment,” “an embodiment,”“an example embodiment,” etc., indicate that the embodiment describedmay include a particular feature, structure, or characteristic, butevery embodiment may not necessarily include the particular feature,structure, or characteristic. Moreover, such phrases are not necessarilyreferring to the same embodiment. Further, when a particular feature,structure, or characteristic is described in connection with anembodiment, it is submitted that it is within the knowledge of oneskilled in the art to effect such feature, structure, or characteristicin connection with other embodiments whether or not explicitlydescribed.

In the preceding description and the claims, the terms “coupled” and“connected,” along with their derivatives, may be used. It should beunderstood that these terms are not intended as synonyms for each other.“Coupled” is used to indicate that two or more elements, which may ormay not be in direct physical or electrical contact with each other,co-operate or interact with each other. “Connected” is used to indicatethe establishment of communication between two or more elements that arecoupled with each other.

While the flow diagrams in the figures show a particular order ofoperations performed by certain embodiments of the invention, it shouldbe understood that such order is exemplary (e.g., alternativeembodiments may perform the operations in a different order, combinecertain operations, overlap certain operations, etc.).

While the invention has been described in terms of several embodiments,those skilled in the art will recognize that the invention is notlimited to the embodiments described, can be practiced with modificationand alteration within the spirit and scope of the appended claims. Thedescription is thus to be regarded as illustrative instead of limiting.

What is claimed is:
 1. A computer-implemented method, comprising:receiving, over a transport connection between a client device and aserver, a first request message; determining a first congestion controlalgorithm based on the first request message; applying the firstcongestion control algorithm to the transport connection for applicationto a transmission of a first response message to the first requestmessage; receiving, over the transport connection from the clientdevice, a second request message; determining a second congestioncontrol algorithm based on the second request message; and applying thesecond congestion control algorithm to the transport connection forapplication to a transmission of a second response message to the secondrequest message, wherein the second congestion control algorithm isdifferent from the first congestion control algorithm.
 2. Thecomputer-implemented method of claim 1, further comprising: prior toapplying the second congestion control algorithm to the transportconnection, determining that the transport connection is idle.
 3. Thecomputer-implemented method of claim 1, wherein applying the secondcongestion control algorithm to the transport connection for applicationto the transmission of the second response message comprises:determining an expected bandwidth for the transport connection based ona history of the transport connection; and initiating the secondcongestion control algorithm with a different value for a state variablebased on the expected bandwidth and round-trip time for the transportconnection.
 4. The computer-implemented method of claim 1, whereindetermining the first congestion control algorithm based on the firstrequest message comprises: identifying characteristics of the firstrequest message; and determining that the characteristics of the firstrequest message matches one or more congestion control rules.
 5. Thecomputer-implemented method of claim 1, wherein determining the firstcongestion control algorithm based on the first request messagecomprises: identifying that a first pathname in the first requestmessage indicates the first request message is a request for firstcontent having a first size greater than a threshold size; and selectingthe first congestion control algorithm from a plurality of congestioncontrol algorithms based on the first content having the first sizegreater than the threshold size.
 6. The computer-implemented method ofclaim 1, wherein determining the second congestion control algorithmbased on the second request message comprises: identifying that a secondpathname in the second request message indicates the second requestmessage is a request for second content having a second size less than athreshold size; and selecting the second congestion control algorithmfrom a plurality of congestion control algorithms based on the secondcontent having the second size less than the threshold size.
 7. Thecomputer-implemented method of claim 1, wherein determining the firstcongestion control algorithm based on the first request messagecomprises: parsing a first header of the first request message todetermine a first size of first content requested in the first requestmessage; and selecting the first congestion control algorithm from aplurality of congestion control algorithms based on the first contenthaving the first size greater than a threshold size.
 8. A non-transitorymachine-readable storage medium that provides instructions that, whenexecuted by a processor, cause said processor to perform operationscomprising: receiving, over a transport connection between a clientdevice and a server, a first request message; determining a firstcongestion control algorithm based on the first request message;applying the first congestion control algorithm to the transportconnection for application to a transmission of a first response messageto the first request message; receiving, over the transport connectionfrom the client device, a second request message; determining a secondcongestion control algorithm based on the second request message; andapplying the second congestion control algorithm to the transportconnection for application to a transmission of a second responsemessage to the second request message, wherein the second congestioncontrol algorithm is different from the first congestion controlalgorithm.
 9. The non-transitory machine-readable storage medium ofclaim 8, wherein the instructions further causes said processor toperform operations comprising: prior to applying the second congestioncontrol algorithm to the transport connection, determining that thetransport connection is idle.
 10. The non-transitory machine-readablestorage medium of claim 8, wherein applying the second congestioncontrol algorithm to the transport connection for application to thetransmission of the second response message comprises: determining anexpected bandwidth for the transport connection based on a history ofthe transport connection; and initiating the second congestion controlalgorithm with a different value for a state variable based on theexpected bandwidth and round-trip time for the transport connection. 11.The non-transitory machine-readable storage medium of claim 8, whereindetermining the first congestion control algorithm based on the firstrequest message comprises: identifying characteristics of the firstrequest message; and determining that the characteristics of the firstrequest message matches one or more congestion control rules.
 12. Thenon-transitory machine-readable storage medium of claim 8, whereindetermining the first congestion control algorithm based on the firstrequest message comprises: identifying that a first pathname in thefirst request message indicates the first request message is a requestfor first content having a first size greater than a threshold size; andselecting the first congestion control algorithm from a plurality ofcongestion control algorithms based on the first content having thefirst size greater than the threshold size.
 13. The non-transitorymachine-readable storage medium of claim 8, wherein determining thesecond congestion control algorithm based on the second request messagecomprises: identifying that a second pathname in the second requestmessage indicates the second request message is a request for secondcontent having a second size less than a threshold size; and selectingthe second congestion control algorithm from a plurality of congestioncontrol algorithms based on the second content having the second sizeless than the threshold size.
 14. The non-transitory machine-readablestorage medium of claim 8, wherein determining the first congestioncontrol algorithm based on the first request message comprises: parsinga first header of the first request message to determine a first size offirst content requested in the first request message; and selecting thefirst congestion control algorithm from a plurality of congestioncontrol algorithms based on the first content having the first sizegreater than a threshold size.
 15. A apparatus, comprising: a processor;a non-transitory machine-readable storage medium coupled with theprocessor that stores instructions that, when executed by the processor,cause said processor to perform the following: receive, over a transportconnection between a client device and a server, a first requestmessage; determine a first congestion control algorithm based on thefirst request message; apply the first congestion control algorithm tothe transport connection for application to a transmission of a firstresponse message to the first request message; receive, over thetransport connection from the client device, a second request message;determine a second congestion control algorithm based on the secondrequest message; and apply the second congestion control algorithm tothe transport connection for application to a transmission of a secondresponse message to the second request message, wherein the secondcongestion control algorithm is different from the first congestioncontrol algorithm.
 16. The apparatus of claim 15, wherein theinstructions further cause said processor to perform the following:prior to applying the second congestion control algorithm to thetransport connection, determine that the transport connection is idle.17. The apparatus of claim 15, wherein applying the second congestioncontrol algorithm to the transport connection for application to thetransmission of the second response message comprises: determining anexpected bandwidth for the transport connection based on a history ofthe transport connection; and initiating the second congestion controlalgorithm with a different value for a state variable based on theexpected bandwidth and round-trip time for the transport connection. 18.The apparatus of claim 15, wherein determining the first congestioncontrol algorithm based on the first request message comprises:identifying characteristics of the first request message; anddetermining that the characteristics of the first request messagematches one or more congestion control rules.
 19. The apparatus of claim15, wherein determining the first congestion control algorithm based onthe first request message comprises: identifying that a first pathnamein the first request message indicates the first request message is arequest for first content having a first size greater than a thresholdsize; and selecting the first congestion control algorithm from aplurality of congestion control algorithms based on the first contenthaving the first size greater than the threshold size.
 20. The apparatusof claim 15, wherein determining the second congestion control algorithmbased on the second request message comprises: identifying that a secondpathname in the second request message indicates the second requestmessage is a request for second content having a second size less than athreshold size; and selecting the second congestion control algorithmfrom a plurality of congestion control algorithms based on the secondcontent having the second size less than the threshold size.
 21. Theapparatus of claim 15, wherein determining the first congestion controlalgorithm based on the first request message comprises: parsing a firstheader of the first request message to determine a first size of firstcontent requested in the first request message; and selecting the firstcongestion control algorithm from a plurality of congestion controlalgorithms based on the first content having the first size greater thana threshold size.